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(57) ABSTRACT 

A system and method upgrade an original data storage 
system into an enhanced data storage system. The original 
data storage system includes an original storage array con- 
troller device and an original storage array. The original data 
storage system is initially connected to a host system via a 
host bus and presents to the host system an original logical 
volume mapping associated with a logical identifier and 
mapped to a physical data set stored in individual storage 
devices in the original storage array. An enhanced storage 
array controller device is operatively connected to the host 
system via the host bus, and the original storage array 
controller device and a storage connection device coupled to 
another storage array are operatively connecting to the 
enhanced storage array controller device via an intermediate 
bus. The physical, data set of the original storage array is 
redistributed across a plurality of storage arrays, including 
the original and the other storage arrays. The enhanced 
storage array controller device is reconfigured to present to 
the host system a logical volume mapping associated with 
the logical identifier mapping to the physical data set redis- 
tributed across the plurality of storage arrays. 

19 Claims, 7 Drawing Sheets 
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PROVIDING AN UPGRADE PATH FOR AN 
EXISTING DATA STORAGE SYSTEM 

TECHNICAL FIELD 

The present application relates generally to data storage 
systems and more particularly to adding storage capacity, 
performance, and/or functionality to an existing data storage 
system. 

BACKGROUND OF THE INVENTION 

Host computer systems often connect to one or more 
storage controllers that provide access to an array of storage 
devices. In a common storage controller, microprocessors 
communicate the data between the storage array and the host 
computer system. The host system addresses a "volume" of 
stored data through the storage controller using a logical 
identifier, such as Logical Unit Number (LUN) used in SCSI 
(Small Computer System Interface) subsystems. The term 
"volume" is often used as a synonym for all or part of a 
particular storage disk, but it also describes a virtual disk 
that spans more than one disk. In the latter case, the virtual 
disk presents a single, contiguous logical volume to the host 
system, regardless of the physical location of the data in the 
array. For example, a single volume can represent logically 
contiguous data elements striped across multiple disks. A file 
structure can also be embedded on top of a volume to 
provide remote access thereto, such as Network File System 
(NFS) designed by Sun Microsystems, Inc. and the Common 
Internet File System (CIFS) protocol built into Microsoft 
WINDOWS products and other popular operating systems. 

Storage controllers come in many flavors. Some storage 
controllers provide RAID (Redundant Array of Independent 
Disks) functionality for a combination of improved fault 
tolerance and performance. In RAID storage controllers on 
an SCSI bus, for example, the host system addresses a 
storage element by providing the single SCSI Target ID of 
the RAID storage controller and the LUN of the desired 
logical volume. A LUN is commonly a three-bit identifier 
used on a SCSI connection to distinguish between up to 
eight devices (logical units) having the same SCSI Target 
ID. Currently, SCSI also supports LUNs up to 64-bits. The 
RAID storage controller corresponding to the provided SCSI 
Target ID translates the LUN into the physical address of the 
requested storage element within the attached storage array. 

A volume ID is another form of logical identifier. Volume 
IDs are typically 64-bit or 128-bit globally unique persistent 
world wide names that correspond directly to LUNs or 
identifiers for other storage representations. By providing a 
mapping to LUNs, volume ID's can be remapped if there is 
a collision between LUNs in a storage system, so as to 
present a set of unique volume IDs to a host accessing the 
storage system. 

The term "RAID" was introduced in a paper entitled "A 
Case for Redundant Arrays of Inexpensive Disks (RAID)", 
Patterson et al., Proc. ACM SIGMOD, June 1988, in which 
five disk array architectures were described under the acro- 
nym "RAID". A RAID 1 architecture provides "mirroring" 
functionality. In other words, the data for each volume of a 
primary storage unit is duplicated on a secondary 
("mirrored") storage unit, so as to provide access to the data 
on the secondary storage unit in case the primary storage 
unit becomes inoperable or is damaged. 

A RAID 2 architecture provides error detection and 
correction ("EDC") functionality. For example, in U.S. Pat. 
No. 4,722,085 to Flora et al., seven EDC bits are added to 
each 32-bit data word to provide error detection and error 
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correction capabilities. Each bit in the resultant 39 -bit word 
is written to an individual disk drive (requiring at least 39 
separate disk drives to store a single 32-bit data word). If one 
of the individual drives fails, the remaining 38 valid bits can 

5 be used to construct each 32-bit data word, thereby achiev- 
ing fault tolerance. 

A RAID 3 architecture provides fault tolerance using 
parity-based error correction. A separate, redundant storage 
unit is used to store parity information generated from each 

10 data word stored across N data storage units. The N data 
storage units and the parity unit are referred to as an "N+l 
redundancy group" or "drive group". If one of the data 
storage units fails, the data on the redundant unit can be used 
in combination with the remaining data storage units to 

15 reconstruct the data on the failed data storage unit. 

A RAID 4 architecture provides parity-based error cor- 
rection similar to a RAID 3 architecture but with improved 
performance resulting from "disk striping". In disk striping, 
a redundancy group is divided into a plurality of equally 

20 sized address areas referred to as blocks. Blocks from each 
storage unit in a redundancy group having the same unit 
address ranges are referred to as "stripes". Each stripe has N 
blocks of data of different storage devices plus one parity 
block on another, redundant storage device, which contains 

25 parity for the N data blocks of the stripe. A RAID 4 
architecture, however, suffers from limited write (i.e., the 
operation of writing to disk) performance because the parity 
disk is burdened with all of the parity update activity. 

3Q A RAID 5 architecture provides the same parity-based 
error correction as RAID 4, but improves "write" perfor- 
mance by distributing the data and parity across all of the 
available disk drives. A first stripe is configured in the same 
manner as it would be in RAID 4. However, for a second 

35 stripe, the data blocks and the parity block are distributed 
differently than for the first stripe. For example, if N+l 
equals 5 disks, the parity block for a first stripe may be on 
disk 5 whereas the parity block for a second stripe may be 
on disk 4. Likewise, for other stripes, the parity disks are 

^ distributed over all disks in the array, rather than in a single 
dedicated disk. As such, no single storage unit is burdened 
with all of the parity update activity. 

A RAID 6 architecture is similar to RAID 5, with 
increased fault tolerance provided by independently com- 

45 puled redundancy information in a N+2 redundancy group. 
A seventh RAID architecture, sometimes referred to as 
"RAID 0", provides data striping without redundancy infor- 
mation. Of the various RAID levels specified, RAID levels 
0, 1, 3, and 5 are the most commonly employed in com- 

5 o mercial settings. 

Other storage controllers do not provide RAID function- 
ality and merely present the host system with access to 
multiple disks in an enclosed array (often referred to as a 
JBOD or "Just a Bunch Of Disks"), without providing the 

55 virtual disk functionality. When a JBOD is connected via a 
SCSI bus, for example, each disk is addressed with both a 
SCSI Target ID and at least one LUN. Such storage con- 
trollers do not provide RAID functionality, but are intended 
primarily to provide access to multiple disks and to monitor 

$0 the environment within a disk array enclosure. 

Invariably, the data storage needs of a business tend to 
grow over time. A data storage solution that initially seemed 
adequate can become severely inadequate over time, par- 
ticularly in terms of storage capacity, performance, and 

65 functionality. As a result, users typically wish to upgrade or 
enhance their data storage systems, preferably without com- 
pletely losing their capital investment in the components of 



07/22/2004, EAST Version: 1,4.1 



US 6,304,942 Bl 

3 4 

the original data storage configuration. It is therefore desir- nects the first storage array controller to the enhanced 

able to reuse components of an original data storage con- storage array controller. 

figuration in an upgraded data storage configuration. These and various other features as well as advantages 

Additionally, users would benefit from an upgrade that does mat characterize the invention will be apparent from a 

not require backing up data from existing arrays in the 5 reading of the following detailed description and a review of 

storage system and restoring the data to the upgraded storage the associated drawings. 



system with the additional capacity. 

SUMMARY OF THE INVENTION 



BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 illustrates an original data storage system in an 



DETAILED DESCRIPTION OF THE 
INVENTION 



The present invention provides advantages over existing 10 embodiment of the present invention, 

upgradeable storage system. An embodiment of the present fig. 2 illustrates a logical diagram of a storage array 

invention consolidates existing arrays and controllers behind controller device configured in pass-through mode in an 

a single entity, which has been shown to decrease the cost of embodiment of the present invention, 

ownership over the life of the storage system. Additional FIG. 3. depicts an upgraded data storage system in an 

performance may also be achieved by incorporating an cmbodimcnt of thc prescnt invention, 

enhanced storage controller device, preferably including a , .„ . * . . , , 

larger cache, a faster processor, and/or a higher bandwidth 4 lUustr * tes * method of u Pg' adia g °n»nal data 

bus than the original storage controller devices. In addition, system by adding more capacity in an embodiment 

the enhanced storage controller can provide additional chan- of the presem inventlon * 

nels to a larger drive group, which can also increase per- 20 FIG. 5 depicts a flowchart of operations for redistributing 
formance. Enhanced storage controllers can provide addi- data from ^ existing ELB storage arrays with an addi- 
tional functionality, such as back up capabilities, higher tional storage array in an embodiment of the present inven- 
levels of RAID, and hierarchical storage management uon - 

(HSM). The transition to an upgraded system can also FIG. 6 illustrates a logical diagram of an environmental 

provides data consistency with the previous configuration 25 services monitor (ESM) providing pass- through relation- 

(i.e., preserving the logical volumes presented to the host ships in an embodiment of the present invention, 

system), while automatically expanding to take advantage of FIG. 7 illustrates an upgraded data storage system includ- 

additional capacity, performance, and functionality. ing one or more ESMs in an embodiment of the present 

An embodiment of the present invention provides a 30 invention, 
method of upgrading a first data storage system into an 
enhanced data storage system., The first data storage system 
is operatively connected to a host system via a host bus and 

includes a first storage array controller device and a first FIG. 1 illustrates an original data storage system 100 in an 

storage array. The first storage array controller device pre- 35 embodiment of the present invention. A host system 102 is 

sents to the host system a first logical volume mapping coupled by host adapters 104 and 106 to an entry level 

associated with a logical identifier, which maps to a physical bridge storage arrays 108 and 110 by host buses 112 and 114. 

data set stored in individual storage devices in the first While the host system 102 is preferably a personal computer 

storage array. The first storage array controller device is (or "PC" type) or server computer system, it should be 

disconnected from the host bus, A second storage array is 40 clearly understood that the present invention is equally 

operatively connected to a storage connection device. An suitable for use with other computing environments not 

enhanced storage array controller device is operatively con- specifically disclosed herein including mainframe comput- 

nected to the host system via the host bus. ers and minicomputers. In a preferred embodiment, the host 

The first storage array controller device and the storage system includes at least one x86 microprocessor and acts as 

connection device are operatively connecting to the 45 a server in a distributed computing environment. The host 

enhanced storage array controller device via an intermediate buses 112 and 114 are preferably well-known SCSI buses, 

bus. The physical data set of the first storage array is Alternatively, other bus architectures may be employed in 

redistributed across a plurality of storage arrays, including embodiments of the invention, including without limitation 

the first and the second storage arrays. The enhanced storage fiber channel or PCI (Peripheral Component Interconnect), 

array controller device is reconfigured to present a second 50 Entry level bridge (ELB) RAID controllers 116, 118, 120 

logical volume mapping associated with the logical identi- and 122, represent low end RAID controllers operatively 

fier mapping to the physical data set redistributed across the connecting a host adapter (e.g. host adapter 104) to a storage 

plurality of storage arrays. array, such as storage array 108. Intervening devices or 

Another embodiment of the present invention provides an interconnections may also be disposed between the host 

upgraded data storage system coupled to a host system via 55 adapter and the storage array. In an alternative embodiment, 

a host bus. A first storage array stores a physical data set on each ELB RAID controller in the original data storage 

individual storage devices. A first storage array controller system may be replaced with PCI RAID controllers or other 

device presents a first logical volume mapping associated low end RAID controllers, wherein buses 112 and 114 are 

with a logical identifier and mapped to the physical data set, compatible with the low end RAID controller and host 

The first storage array controller is configured to pass 60 adapter. 

through communications in a one-to-one correspondence In the illustrated embodiment of FIG. 1, RAID controller 

between the enhanced storage array controller device and 116, for example, preferably provides a level of RAID 

individual disks in the first storage array. An enhanced functionality, disk caching, and environmental monitoring, 

storage array controller is operatively connected to the host The RAID controller 116 presents its own volumes to the 

system via the host bus and presents a second logical volume 65 host adapter 104 and maps logical unit numbers (LUN) 

mapping associated with the logical identifier and mapped to appropriately to the data stored in storage array 108. In a 

the physical data set. An intermediate bus operatively con- typical scenario, the ELB RAID controller 116 "stripes" a 
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volume across all five storage disks of disk arrays 124 and 118, 120, and 122 of FIG. 1 include a setiable pass-through 

126 to provide RAID 0 functionality. RAID controller 118 mode, which disables all or a portion of the controller's 

presents volumes mapped to disk arrays 124 and 126 to RAID functionality and presents a one-to-one correspon- 

provide dual access to the storage arrays. In a similar dence between the LUNs presented to the host bus (e.g., 112 

manner, the ELB RAID controller 120 presents volumes 5 and 114) and the physical storage disks in the disk array. In 

mapped to disk arrays 128 and 130, The ELB RAID FIG - controllers 116, 118, 120, and 122 are not set in 

controller 122 also presents volumes mapped to disk arrays pass-through mode, but are set to provide RAID function- 

128 and 130. amv - 

Alternatively, such as in a fiber channel embodiment, the ™- ^ iUustratcs t storage array controller device 200 

drives in storage arrays 124 and 126 are preferably dual- "> configured in pass-through mode in an embodiment of the 

ported. As such, both controllers 116 and 118 may be mvcnUon - * \^ 0Wn ; stora S e *sks shown generally 

connected to all of the drives in the storage arrays 124 and at 202 > ™ ™ u P. Ied 10 s ora S e «>^«« ports shown 

+ u , . , „ u * j generally at 204, in a one-to-one correspondence. A trans- 

126, or alternatively, each controller may be connected r> . J , . . ' - . . . . . *~ „ . . . . 

■ . « i J , - , - . / A a lion module 206 is coupled to the ports 204 to translate 

independently to a subset of the drives in the storage arrays t t V* . \ Z , -IS ■ r 

124 and 126 15 tar S et ^ s associated with each of the storage disks 202 into 

„^ . ' ,„ „ logical identifiers (e.g., LUNs). The translation module 206 

FIG. 1 also illustrates an example of redundant channels. may also provide disk cachingj rairroring) and environmen- 

That is, a drive in array 126 may be accessed via either ^ monitoring 

controller 116 or 118. Therefore, if one or the other control- „ shou , d be underslood , hal ^ volumes med t0 the 

ler fails, a host system may still access the drive through the hQS , b , h< . e m m [he 

remaining controller, n an alternate embodiment of the ori ^ nal datfl m no( ^ saffle uni , s 

present mvennon a storage array that lacks such channel n , ed . mc ^ m 

in pass-through mode. In 

redundancy may be incorporated into an upgraded storage Qther word in a „ embodimem of an ori ^ al dala st0 

system that supports channel redundancy That ls the data in , , LUN 0 consis[s of da , a s , ri ^ across „ of £ 

he longmal storage array can be reconfigured (e.g redjs- e disks 202 an(J LUN x of da , a - m m 

tribute! and remapped) throughout the added capacity of the alternativ6 stri acK)SS aU of the „ disks 2fl2 In 

upgraded storage system to prov.de channel redundancy to confrast when me e 2W) ^ ^ to 

the data that was initially stored in the original storage array. *u u j riTxrn- j* j* * i 

o »u j- c rlr -» c • c pass-through mode, LUN 0 is mapped to data on a single 

See the discussion or FIG. 3 for more information. 4 j* i , rnx , , . rr , . t . 

storage disk, and LUN 1 is mapped to data stored on a 

In the original data storage system of FIG. 1, the host 3Q different single storage disk, as shown in FIG. 2. 

system 102 has access to four disk arrays (i.e., 124, 126, 128, Accordingly, the underlying storage arrays appear as JBODs 

and 130) via entry level bridge RAID controllers (i.e. 116, to an enhanced storage array controller coupling the original 

118, 120, and 122) to obtain storage capacity, data storage storage arrays to the host system in an upgraded data storage 

performance, and RAID functionality. However, while the system. In pass-through mode, a storage array controller 

configuration illustrated in FIG. 1 may have met a user's 35 device acts as, and may be considered, a storage connection 

original requirements, as the user's needs increase in terms device. 

of storage capacity, performance, and/or RAID Fia 3 d icts an upgraded storage sys tem 300 in an 

functionality, a user may find the original data storage embodiment of the present invention. The host system 102 

system 100 inadequate. with host adapters ^ pre f e rably the same host system as in 

A user in such a situation has several alternatives. First, 40 FIG. 1. Likewise, storage arrays 108 and 110 are preferably 

for example, a user may add additional disk drives to one or the same as those illustrated in FIG. 1, although the ELB 

more of the disk arrays in order to increase storage capacity. RAID controllers 116, 118, 120 and 122 will be configured 

Furthermore, employing a feature called Dynamic Capacity in pass-through mode. A third storage array 302 has been 

Expansion (DCE), the user can automatically reconfigure added to the original data storage system to provide added 

the data on the original disks of a storage array, distributing 45 storage capacity and increased performance. The ELB 

it across both the original storage disks and the added RAID controllers 304 and 306 are coupled to the enterprise 

storage disks. After reconfiguration, all data is distributed storage controllers 308 and 310 (i.e., enhanced storage array 

evenly across all storage disks in the storage array, while the controllers), which may alternatively be any storage array 

RAID controller continues to present the same logical controller with increased performance, increased channel 

volumes to the host system. Likewise, all unused capacity 50 capacity, or increased storage management functionality 

appears evenly distributed across all drives following the (e.g., RAID management or data management) over the 

last LUN. Therefore, unused capacity may be used to create ELB RAID controllers. The ELB RAID controllers 116, 118, 

additional LUNs. Generally, DCE is limited by the maxi- 120 and 122, from the original data storage system, are 

mum number of storage disks a particular RAID controller disconnected from the host system and are also connected to 

can support and by the number of channels available to 55 the enterprise storage controllers 308 and 310, which are 

access the plurality of storage disks in the array. coupled to the host system 102. 

In addition, a user may upgrade from a lower RAID level After the new storage array 302 and enterprise storage 

(e.g., RAID 0) to a higher RAID level for a particular LUN controllers 308 and 310 are added to the original data storage 

using Dynamic RAID Migration (DRM), which causes the system, there exists new capacity and additional channels 

LUN to be automatically reconfigured such that the data is 60 that can be used to optimize the performance of the upgraded 

re-mapped according to the definition of the new RAID storage system 300. As a result, when the additional capacity 

level. Unfortunately, if the upgrade is to a RAID level not is detected via an administration tool or by automatic means, 

supported by the ELB RAID controller or PCI RAID the user or the host system itself issues a command to one 

controller in the disk array, it must be replaced by a RAID or both of the enterprise storage controllers 308 and 310 

controller with higher levels of functionality. To accommo- 65 commanding them to put the ELB RAID controllers into 

date such upgrades without requiring replacement of the pass-through mode. An enterprise storage controller (such as 

existing RAID controllers, the ELB RAID controllers 116, 308) then reads metadata (i.e., configuration information) 
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from on -media storage called a Dacstore. Generally, a 
Dacsiore records the logical mapping information corre- 
sponding to each storage device in the array, and is described 
in more detail in U.S. Pat. No. 5,822,782 to Humlicek et al., 
specifically incorporated herein for all that it discloses and 
leaches. 

Using the metadata information, the enterprise storage 
controller reconstructs the logical mappings of volumes 
stored in and presented to the host system in the original data 
storage system. After reading the metadata from each stor- 
age disk, the enterprise storage controller reconfigures the 
data stored in the original data storage system so as to 
distributed it evenly throughout the existing storage capacity 
in the upgraded data storage system 300. A method for 
reconfiguring data for a six channel storage array controller 
in which channel redundancy is required for the upgraded 
data storage system is illustrated in FIG. 5. 

The embodiments illustrated in FIGS. 1 and 3 include two 
dual -channel storage arrays with ELB RAID controllers 
upgraded to 3 dual channel -storage arrays with ELB RAID 
controllers configured in pass-through mode and coupled 
behind two enterprise storage controllers. Other configura- 
tion upgrades are contemplated in other embodiments of the 
present invention, including for example a single-channel 
storage array controller being supplemented by a second 
single-channel storage array controller behind a higher chan- 
nel capacity storage controller. Importantly, the pass- 
through relationships presented by the original controller or 
controllers facilitate the reconfiguration performed by the 
enhanced storage array controller by presenting the storage 
devices in the underlying arrays as a JBOD. 

The redistribution and remapping of the data in a drive 
group also provides an upgrade path from an original storage 
system that lacks channel redundancy to an upgraded stor- 
age system that accommodates channel redundancy. 
Assuming, for example, that the original storage array 108 
did not provide channel redundancy, the volume data can be 
redistributed and remapped such that enterprise storage 
controllers 308 and 310 can provide the redundant paths to 
the data for a particular volume. 

FIG. 4 illustrates a method of upgrading an original data 
storage system by adding more capacity in an embodiment 
of the present invention. It should be understood that it is not 
necessary to add capacity to upgrade an original data storage 
system. For example, additional channels may be added to 
an original data storage system to increase availability of 
existing storage. Alternatively, a higher level of RAID may 
be achieved by upgrading an original data storage system to 
entry level bridge RAID controllers to enterprise RAID 
controllers, for example. 

Operation 400 starts the upgrade process. The process 
starts with an original storage array controller device con- 
nected to a host system. An original storage array is coupled 
through the original storage array controller device to a host 
system (see FIG. 1). It is understood that the original storage 
array controller device of FIG. 1 is configurable to support 
a pass-through mode. The original storage array stores 
metadata defining the configuration of the logical volume 
mappings in the storage array. In operation 402, the original 
storage array controller device and the original storage array 
are disconnected from the host system. Operation 404 con- 
nects an enhanced storage array controller device to the host 
system. Preferably, the enhanced storage array controller 
device includes at least one of an increased number of disk 
channels, higher performance capability, or increased RAID 
functionality. In operation 406, the original storage array 
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controller device (and the original storage array) is con- 
nected to the enhanced storage array controller device. 
Operation 408 connects a storage connection device and an 
additional storage array to the enhanced storage controller 

5 device. The storage connection device may include without 
limitation a storage array controller device set in pass- 
through mode, a PCI RAID controller device set in pass- 
through mode, or an environmental services monitor (ESM). 
In operation 410, the enhanced storage array controller 

10 device detects the new capacity provided by the additional 
storage array through the storage connection device. 
Alternatively, instead of automatic detection of new 
capacity, the enhanced storage array controller device may 
receive a command from the host system to initiate a 

j 5 reconfiguration process. In operation 412, the enhanced 
storage array controller device issues a command to the 
original storage array controller device, and to the storage 
connection device, if necessary. The command of operation 
412 causes the original storage array controller device (and 

20 the storage connection device, if necessary) to be configured 
in pass-through mode. In operation 414, the enhanced stor- 
age array controller device copies data from what was the 
first volume presented to the host system by the original 
storage array controller device across the first and second 

25 storage arrays. In operation 416, the enhanced storage array 
controller device re-maps the first volume that was presented 
by the original storage array controller device to the host 
system to the data that is now redistributed across the first 
and second storage arrays, so that the enhanced storage array 

30 controller device presents the same first volume and corre- 
sponding data to the host system. Operations 414 and 416 
are preferably iterative, copying disks across non- 
overlapping channels and then remapping the volume data 
on these disks. Operations 414 and 416 are performed so as 

35 not to interfere with the I/O (input/output) operations from 
a host system. The process stops in operation 418, however, 
if additional volumes were presented by the original storage 
array controller device, the enhanced storage array control- 
ler device may also have reconfigured these volumes across 

40 the available storage capacity. 

FIG. 5 depicts a flowchart of operations for redistributing 
data from two existing ELB storage arrays when an addi- 
tional storage array is added in an embodiment of the present 
invention. The original data storage system is assumed to be 

45 similar to that as shown in FIG. 1. In operation 500, the 
redistribution process starts, preferably in reaction to a 
detection of added storage capacity from an additional 
storage array or to a host command. In operation 502, the 
enhanced storage array controller device reads the metadata 

50 from the original storage arrays to determine the logical 
volume mappings supported by the storage arrays. 

For each drive group, the enhanced data storage array 
controller device in operation 504 locates the first two 
storage devices (i.e., Al and A2) of the first storage array 

55 (e.g., storage array 108 in FIG. 1) having overlapping 
channels with respect to the other storage devices in the 
drive group. An "overlapping channel" refers to a single 
channel coupled to multiple drives in the same drive group. 
In operation 506, the enhanced storage array controller 

60 device copies the data on the storage devices Al and A2 on 
different channels to the additional storage array. The two 
devices Al and A2 in the first storage array are now 
available to store new data. 
In operation 508, the enhanced storage array controller 

65 device locates the first two storage devices Bl and B2 on the 
second storage array (e.g., storage array 110 in FIG. 1) 
having overlapping channels in the storage array with 
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respect to the other storage devices in the drive group. In 
operation 510, the enhanced storage array controller copies 
the data on the storage devices Bl and B2 on different 
channels to the additional storage array. The two devices Bl 
and B2 in the second storage array are now available to store 
new data. 

In operation 512, the enhanced storage array controller 
device locates the next two storage devices CI and C2 on the 
first storage array having overlapping channels in the storage 
array with respect to the other storage devices in the drive 
group. In operation 514, the enhanced storage array con- 
troller copies the data on the storage devices CI and C2 on 
different channels to the storage devices Bl and B2. The two 
devices CI and C2 in the first storage array are now 
available to store new data. 

In operation 516, the enhanced storage array controller 
device locates the next two storage devices Dl and D2 on 
the second storage array having overlapping channels in the 
storage array with respect to the other storage devices in the 
drive group. In operation 518, the enhanced storage array 
controller copies the data on the storage devices Dl and D2 
on different channels to the storage devices Al and A2. The 
two devices Dl and D2 in the second storage array are now 
available to store new data. 

Note that the drive groups and corresponding storage 
disks are defined by the metadata stored on a reserved region 
of each storage disk. Furthermore, because the enhanced 
storage array controller device has set each of the original 
storage array controller devices into pass- through mode, the 
enhanced storage array controller device can access each 
storage device in the storage array in a one-to-one corre- 
spondence. That is, for example, the enhanced storage array 
controller device sees each storage device in the storage 
array as an individual LUN for each target identifier or as a 
set of individual target identifiers, in the case of an ESM 

After operations 504 through 518 are completed, the 
identifiers Al and A2, Bl and B2, CI and C2, and Dl and 
D2, are reset for iteration through the next drive group in 
operation 520. If on any of the above steps no two drives 
whose positions overlap the channels of the other drives in 
the drive group, the copy operation is performed on the 
single found drive, if possible. If no drives overlap, the 
operation is skipped. If additional volumes exist, operation 
522 directs process to 504 to repeat the process for the 
additional volumes. Otherwise, the redistribution process 
terminates at operation 524. 

FIG. 6 illustrates pass-through relationships provided by 
an ESM 600 in an embodiment of the present invention. 
Individual storage devices 602 correspond to individual 
target identifiers on the storage array side of the ESM. 
Internally, the individual target identifiers are physically 
mapped to individual target identifiers on the host system (or 
enhanced storage array controller) side of the ESM (shown 
generally at 604), providing a one-to-one relationship to 
each individual storage device. In an original data storage 
system, the side 604 of the ESM is preferably connected to 
a host system via a SCSI, PCI, or fiber channel bus. For 
example, on a SCSI bus, each target identifier is a SCSI 
Target ID on the SCSI bus. Alternative interconnections are 
contemplated in other embodiments of the present invention. 
In an upgraded data storage system, the side 604 of the ESM 
is preferably connected to an enhanced storage array con- 
troller device, which is connected to the host system to 
provide upgraded capacity, performance, or RAID 
functionality, It is also to be understood that an ESM is used 
as a storage connection device to couple the additional 
storage array to the enhanced storage array controller. 
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FIG. 7 illustrates an upgraded data storage system includ- 
ing one or more ESMs in an embodiment of the present 
invention. Storage arrays 714 and 716 represent storage 
arrays from the original data storage system. In one embodi- 

5 ment of the present invention, the devices 712, 710, 798, and 
706 include entry level bridge RAID controllers or other 
storage array controllers used in the original data storage 
system and configured to provide pass-through relationships 
to the enterprise controllers 720 and 722. Alternatively, the 

10 storage array controllers used in the original data storage 
system are replaced with ESMs and reused in other data 
storage systems. In either embodiment, the devices 702, 704, 
706, 708, 710, and 712 provide pass-through relationships to 
storage devices in the underlying storage arrays. Devices 

15 702,704 and 706 are connected to enterprise storage con- 
troller 722 through disk channels 724. Devices 708,710, and 
712 are connected to enterprise storage controller 720 
through disk channels 726. 
The above specification, examples and data provide a 

20 complete description of the manufacture and use of the 
composition of the invention. Since many embodiments of 
the invention can be made without departing from the spirit 
and scope of the invention, the invention resides in the 
claims hereinafter appended. 

25 What is claimed is: 

1. A method of upgrading a data storage system into an 
enhanced data storage system, said data storage system 
including a first storage array controller device operatively 
connected to a host system and to a first storage array, the 

30 method comprising: 

interposing an enhanced storage array controller between 

said first storage array controller and said host system; 
operatively connecting a second storage array to a storage 

connection device; 
operatively connecting said storage connection device to 

said enhanced storage array controller; 
redistributing data from said first storage array across a 

plurality of storage arrays, including said first storage 
^ array and said second storage array; and 

providing a logical to physical map operative to access 

data redistributed across said plurality of storage 

arrays. 

2. The method of claim 1 further comprising: 

45 configuring said first storage array controller to operate in 
a pass-through mode whereby individual devices in the 
first storage array may be accessed by said enhanced 
storage array controller. 

3. The method of claim 2 wherein said step of configuring 
50 said first storage array controller to operate in a pass-through 

mode further comprises: 
configuring said first storage array controller to map 
individual storage devices in said first storage array to 
logical identifiers in a one-to-one correspondence. 
55 4. The method of claim 1 wherein said storage connection 
device further comprises: 

an environmental services monitor connecting the indi- 
vidual storage devices of said second storage array to 
said enhanced array controller wherein said environ- 
60 mental services monitor is configured in a pass-through 
mode. 

5. The method of claim 1 wherein said storage connection 
device comprises a second storage array controller operating 
in pass-through mode. 
65 6. The method of claim 1 wherein said enhanced array 
controller provides more disk channels than said first storage 
array controller. 
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7. The method of claim 1 wherein said enhanced array 
controller provides a higher level of RAID functionality than 
said first storage array controller. 

8. The method of claim 1 further comprising: 

storing information describing mapping of redistributed 5 
data on a storage device contained in said first and 
second storage arrays. 

9. A method for upgrading a data storage system, said data 
storage system including a storage array controller opera - 
tively connected to a host system and to a storage array, the 10 
method comprising: 

interposing an enhanced array controller between said 

storage array controller and said host system; 
configuring said storage array controller to operate in J5 

pass-through mode; and 
creating a logical to physical map operative to allow said 

enhanced storage array controller to access the physical 

data set stored in said storage array. 

10. The method of clam 9 wherein said enhanced array 2 o 
controller provides a higher level of RAID functionality than 
said storage array controller. 

11 . The method of claim 10 wherein said step of config- 
uring said storage array controller further comprises: 

configuring said storage array controller to map drives in 25 
said storage array to logical identifiers in a one-to-one 
correspondence. 

12. An upgraded data storage system comprising: 

an enhanced storage array controller coupled to a host 
system; 30 

a storage array controller coupled to said enhanced stor- 
age array controller wherein said storage array control- 
ler is configured to operate in a pass-through mode; and 

a storage array coupled to said storage array controller 35 
wherein said enhanced storage array controller is con- 
figured to access physical data in said storage array 
associated with a logical identifier. 

13. The upgraded data storage system of claim 12 further 
comprising: 4Q 

a second storage array controller coupled to said enhanced 
storage array controller; and 

a second storage array coupled to said second storage 
array controller, wherein said enhanced storage array 
controller is configured to access a physical data set 
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distributed across a plurality of storage arrays, includ- 
ing said storage array and said second storage array. 

14. Hie upgraded data storage system of claim 13 wherein 
said storage array further comprises: 

configuration data recorded in at least one individual disk 
within said storage array and said second storage array. 

15. The upgraded data storage system of claim 12 wherein 
said storage array controller is replaced by a connection 
device configured to operate in a pass-through mode. 

16. The upgraded data storage system of claim 12 wherein 
said storage array controller is replaced by means for 
passing-through communications in a one-to-one correspon- 
dence between said enhanced storage array controller and 
individual disks in said storage array. 

17. An upgraded data storage system coupled to a host 
system via a host bus, the upgraded data storage system 
comprising: 

a first storage array including first individual storage 
devices; 

a storage array controller that has been configured in 
accordance with said upgraded data storage system to 
pass though communications in a one-to-one corre- 
spondence to and from said first individual storage 
devices in said first storage array; 

a second storage array including second individual stor- 
age devices; and 

an enhanced storage array controller operatively con- 
nected to said host system via said host bus, said 
enhanced storage array controller configuring a physi- 
cal data set across both said first storage array and said 
second storage array to logically map said physical data 
across both said first storage array and said second 
storage array. 

18. The upgraded data storage system of claim 17 further 
comprising: 

configuration data recorded on one or more individual 
storage devices within said first storage array and said 
second storage array. 

19. The upgraded data storage system of claim 17 wherein 
data stored solely in said first data storage array lacks 
channel redundancy, and data stored across both said first 
storage array and said second storage array is channel 
redundant. 

***** 
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